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We show that finding the lowest eigenvalue of a 3-local symmetric stochastic matrix is QMA- 
complete. We also show that finding the highest energy of a stoquastic Hamiltonian is QMA- 
complete and that adiabatic quantum computation using certain excited states of a stoquastic 
Hamiltonian is universal. We also show that adiabatic evolution in the ground state of a stochastic 
frustration free Hamiltonian is universal. Our results give a new QMA-complete problem arising in 
the classical setting of Markov chains, and new adiabatically universal Hamiltonians that arise in 
many physical systems. 



I. INTRODUCTION 

Quantum complexity theory is the study of the ca- 
pabilities and limitations of computational devices op- 
erating according to the principles of quantum mechan- 
ics 0]. Because many of the classical constructs of com- 
puter science (e.g. circuits and clauses) are replaced by 
matrices, quantum complexity theory is sometimes re- 
ferred to as matrix-valued complexity theory [ToL [l2| . In 
addition to its intrinsic interest this subject has many 
connections to issues of practical relevance to physical 
science, such as the difficulty of computing properties of 
quantum systems using either quantum or classical de- 
vices [H 01 S3 • 

Perhaps the most basic classical complexity classes are 
P - the class of problems solved by a deterministic Turing 
machine in polynomial time, and NP - the class of prob- 
lems whose verification lies in P. It is widely believed, but 
not proven, that NP is strictly larger than P [26| . 

Because quantum mechanics only predicts probabili- 
ties of events, the classical deterministic classes are not 
the most natural place to start if one seeks their quan- 
tum generalizations. The probabilistic generalization of 
P is BPP (Bounded-error Probabilistic Polynomial-time) 
- those problems solvable by a probabilistic Turing ma- 
chine in polynomial time with bounded error jl|. The 
quantum generalization of this class is BQP (Bounded- 
error Quantum Polynomial-time) - the class of problems 
solvable in polynomial time with bounded error on a 
quantum computer [7|. 

The classical probabilistic generalization of NP is the 
class MA [5[ . This generalizes NP to problems whose ver- 
ification is in BPP. MA stands for Merlin- Arthur. Merlin, 
who is computationally unbounded but untrustworthy, 
provides a proof that Arthur can verify using his BPP 
machine. The class MA possesses a quantum generaliza- 
tion to QMA (Quantum Merlin Arthur) HHI^. Q MA 



may be intuitively understood as the class of decision 
problems that can be efficiently verified by a quantum 
computer. 

Given a classical description of a decision problem x of 
length n, the prover, Merlin, provides a witness state \ip) 
to the verifier, Arthur. Arthur then peforms a poly(n)- 
time quantum computation on the witness \ip) and cither 
accepts or rejects. A problem is contained in QMA if, for 
all YES instances, there exists a witness causing Arthur 
to accept with probability greater than 2/3 and for NO 
instances, there does not exist any witness that causes 
Arthur to accept with probability greater than 1/3. A 
problem X is said to be QMA-complete if it is contained 
in QMA and every problem in QMA can be converted to 
an instance of X in classical polynomial time. 

Let us consider the following question: What is the 
ground state energy of a quantum system? This ques- 
tion lies at the core of many areas of physical science, 
including electronic structure theory and condensed mat- 
ter physics. In quantum complexity theory this problem 
has been formalized (originally by Kitaev [l~8j|, see also, 
for example, [16|) as the k- local Hamiltonian problem. 
For some systems, complexity-theoretic arguments sug- 
gest that efficient computation of the ground state energy 
is likely to remain beyond reach [6|, [18[ . 

A Hamiltonian H, acting on n qubits, is said to be 
/c-local if it is of the form 



where each H s acts on at most /c-qubits. Thus, for 
example, 1-local Hamiltonians consist only of external 
fields acting on individual qubits, and 2-local Hamil- 
tonians consist of 1-local terms and pairwise couplings 
between qubits. Physically realistic Hamiltonians are 
usually /c-local with small k, often 2 or 1, and each 
local term has bounded norm. Note that this notion of 
locality has nothing to do with spatial locality; a 2-local 
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Hamiltonian may have long-range couplings but they 
must be pairwise. 

Problem: fc-local Hamiltonian 

Input: We are given a classical description of a fc- 
local Hamiltonian H on n qubits H = X^=i Hj with 
r = poly(n). Each Hj acts on at most fc qubits and 
has O(l) operator norm. In addition we are given 
two constants a and b such that < a < 6, and 
b — a = e > l/poly(n). 

Output: If H has an eigenvalue < a answer YES. If all 
eigenvalues of H are > b answer NO. 
Promise: the Hamiltonian is such that it will produce 
either YES or NO. 

Perhaps a more obvious formulation of this prob- 
lem is to ask for an approximate ground state energy to 
within ±e of the correct answer. However, if one can 
decide the answer to fc-local Hamiltonian in polynomial 
time, then one can solve the approximation version 
in polynomial time by a binary search. Thus, the 
approximation problem is of equivalent difficulty to the 
"decision" version, to within a polynomial factor. 

The problem fc-local Hamiltonian is QMA-complete for 
fc > 2 [16j . The fc-local Hamiltonian problem is specified 
by the matrix elements of the local terms of H . YES 
instances possess the ground state as a witness. The 
verification circuit is the phase estimation algorithm - a 
suitably formalized version of the notion of energy mea- 
surement [l8(. If the lowest eigenvalue of H is less than 
a (a YES instance) then Arthur will accept the ground 
state as a witness. However, if the lowest eigenvalue of 
H is greater than b (a NO instance) then Merlin cannot 
supply any eigenstate or superposition of eigenstates that 
will result in a measurement of energy less than b. 

It is considered unlikely that QMA C BQP and there- 
fore it is probably impossible to construct a general quan- 
tum (or classical) algorithm that finds ground state en- 
ergies in polynomial time. However, many Hamiltoni- 
ans studied in practice have additional restrictions be- 
yond fc-locality. In particular, many physical systems are 
stoquastic, meaning that all of their off-diagonal matrix 
elements are nonpositive in the standard basis. This in- 
cludes the ferromagnetic Heisenberg model, the quantum 
transverse Ising model, and most Hamiltonians achiev- 
able with Josephson-junction flux qubits 11]. In fll| it 
was shown that for any fixed fc, stoquastic fc-local Hamil- 
tonian is contained in the complexity class AM. Thus, 
unless QMA C AM (which is believed to be unlikely) , 
stoquastic fc-local Hamiltonian is not QMA-complete |28j . 
It was also shown in [ll[ that, for any fixed fc, adiabatic 
quantum computation in the ground state of a fc-local 
stoquastic Hamiltonian can be simulated in BPP pa th- 
Thus, unless BQP C BPP pat h (which is also believed to 
be unlikely), such quantum computation is not universal. 
The work of [1(3] also defines a random stoquastic local 
Hamiltonian problem which is complete for the class AM. 

These results were tightened further for stoquastic 



frustration free (SFF) Hamiltonians in 12]. A local 
Hamiltonian is frustration free if it can be written as 
a sum of terms 

m 

ff = X>s, (1) 

s 

such that 

1. Each local operator H s is positive semidefinite 

2. The ground state \ifj) of H satisfies H s \ip) = for 
each s G {1, . . . , m} 

The work of [l2j showed that an adiabatic evolution 
along a path composed entirely of SFF Hamiltonians may 
be simulated by a sequence of classical random walks - 
that is, the adiabatic evolution may be simulated in the 
complexity class BPP. 

These results were extended to the quantum fc- 
satisfiability problem in floL [l2| . The quantum 
fc-satisfiability problem was defined in Q and we repro- 
duce the definition here: 

Problem: Quantum fc-SAT 

Input: A set of fc-local projectors {n f/ } for 
q € {l,...,m} where m — poly (n) and a parame- 
ter e > l/poly(n) 

Output: If there is a state \<j>) such that IIi|</>) = for 
each q £ {1,...,M}, then this is a YES instance. If 
every state \(j>) satisfies 

M 
9=1 

then it is a NO instance. 

Promise: The instance is either YES or NO. 

In [10 ] the stoquastic restriction of quantum fc-SAT was 
shown to be contained in MA for any constant fc, and 
MA-complete for fc = 6 - the first nontrivial example 
of an MA-complete problem. In [l2j these results were 
extended to a simplified form of stoquastic quantum 
fc-SAT in which projectors n a all have matrix elements 
taken from the set {0,1/2,1}, and the stoquastic con- 
straints which appear as terms in the Hamiltonian are 
of the form H a = 1 — II a . 

The main intuition behind these results is that, by 
the Perron-Frobenius theorem, the ground state of a sto- 
quastic Hamiltonian consists entirely of real positive am- 
plitudes (given the appropriate choice of global phase). 
Thus the ground state is proportional to a classical prob- 
ability distribution. For this reason, ground state prop- 
erties are amenable to classical random walk algorithms 
and certain problems such as stoquastic fc-local Hamil- 
tonian fall into classical probabilistic complexity classes 
such as AM. Diffusion Quantum Monte Carlo calcula- 
tions for stoquastic Hamiltonians do not suffer from the 
sign problem because the negativity of the nonzero off- 
diagonal matrix elements guarantees that the transition 
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probabilities in the associated random walk are all posi- 
tive. 

In this paper we first demonstrate that stoquastic 
Hamiltonians may be constructed which allow univer- 
sal adiabatic quantum computation in a subspace. Then 
we show that the 3-local Hamiltonian problem is QMA- 
complete when restricted to stochastic Hamiltonians. 
These are Hamiltonians in which all matrix elements 
are real and nonnegative, and the sum of matrix ele- 
ments in any row or column is one. Hence determining 
the lowest eigenstate of a symmetric stochastic matrix is 
QMA-hard. If H is a stochastic Hamiltonian, then —H 
is stoquastic. Thus, our result also shows that deter- 
mination of the highest lying eigenstate of a stoquastic 
matrix is QMA-hard, sharpening the intuition that it is 
the positivity of the ground state which causes its local 
Hamiltonian problem to fall in a classical class. We then 
show that universal adiabatic quantum computation is 
possible in the ground state of a stochastic frustration 
free Hamiltonian. Defining the computational problem 
stochastic fc-SAT in analogy to the definition of stoquas- 
tic fc-SAT given in jl2jj, we show that this problem is 
QMAi-complete for fc = 6. (QMAi is a slight variant of 
QMA such that in YES instances, Arthur can be made 
to accept with probability one@.) 



II. QMA-COMPLETENESS AND ADIABATIC 
UNIVERSALITY OF STOQUASTIC 
HAMILTONIANS 



We start with the result of 
Hamiltonian of the form 



which shows that for a 



Hxz — djXj + hjZj + KjjXjXj + JjjZjZj, 

i i i.j i.j 

(2) 

the 2-local Hamiltonian problem is QMA-complete if the 
coefficients di, hi, Kij, Jij are allowed to have both signs. 
Furthermore, time-dependent Hamilonians that take the 
form Hxz at all times can perform universal adiabatic 
quantum computation 

Starting with a Hamiltonian of the form Hxz on n 
qubits we can eliminate the negative matrix elements 
in each term using a technique from [lij]. Essentially, 
the idea is that instead of representing the group Zi by 
{1,-1} we use its regular representation: 



1 
1 



Hxz can be rewritten as 



1 

1 



H 



xz 



^ a k T k 



(3) 



Where each coefficient a k is positive and for each fc, T k 
is one of 



with identity acting on the remaining qubits. For any fc, 
Tfc is a 2™ x 2™ matrix in which each entry is either +1,-1, 
or 0. From T k we construct a 2 n+1 x 2 n+1 matrix T k by 
making the following replacements 
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(5) 



We can interpret T k as acting on n + 1 qubits. The 2x2 
matrices of ([5]) act on the ancilla qubit that has been 
added. Each T k is 2-local or 1-local, thus each corre- 
sponding T k is 3-local or 2-local. Furthermore, each T k 
is a permutation matrix. Let 



H 



xz 



k 



a k T k 



(G) 



This is a linear combination of permutation matrices with 
negative coefficients. By construction, Hxz is therefore 
a 3-local stoquastic Hamiltonian. We can rewrite Hxz 
as 



H X z = H xz ®\-}(-\-H xz ®\+}(+\ (7) 



where 



Hxz = y^ct fc |r fc 



(8) 



\T k \ is the entry- wise absolute value of T k , and 



1 



|+) = _(|0> + |1» 
I-) = ^(|0>-|1». 



and 



act on the ancilla 



zb A, ^slZ , zbA^Aj, ^iZ^Zj 



(4) 



The projectors |— ) 
qubit. 

Equation [7] makes the relationship between the spectra 

of Hxz and Hxz clear. Let |i/>o), IV'i)) • ■ • : IV'iv-i) denote 
the eigenstates of Hxz with corresponding eigenvalues 
A < Ai < ... < Ajv-i,_and let |^ ), |V>i), • • • , \4>N-x) 
denote the eigenstates of Hxz with corresponding eigen- 
values Ao < Ai < . . . < Ajv-i- {Hxz acts on n qubits, so 
N = 2 n .) Hxz, which acts on a 2A^-dimensional Hilbert 
space, has two Y-dimensional invariant subspaces. The 
first is spanned by \tpj) |— ) with eigenvalues Aj. The sec- 
ond is spanned by eigenvectors \ipj) |+) with eigenvalues 

We can perform universal adiabatic quantum compu- 
tation in such an eigenstate of a stoquastic Hamiltonian. 
To prove this, we make use of the universal adiabatic 
Hamiltonian Hxz(t) from which at all t takes the 
form shown in equation [2] One can use the construc- 
tion described above to obtain a stoquastic Hamiltonian 
Hxz(t) corresponding to each instantaneous Hamilto- 
nian Hxz(t)- In this way we obtain a time varying 
Hamiltonian Hxz{t) whose spectrum in the |— ) subspace 
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exactly matches the spectrum of Hxz(t), the only differ- 
ence being the addition of an ancilla qubit in the |— ) 
state. Because H X z(t) has no coupling between the |— ) 
subspace and the |+) subspace, the adiabatic theorem 
may be applied within the |— ) subspace. The relevant 
eigenvalue gap is thus the same as that of Hxz(t), and 
so is the runtime. 

In standard adiabatic quantum computation, the 
qubits arc in the ground state of the instantaneous Hamil- 
tonian. Thus, any disturbance to the state costs energy. 
This is thought to offer some protection against thermal 
noise [131 ] . When performing universal adiabatic quan- 
tum computation with Hxz(t), the qubits are not in the 
ground state. Thus, it is possible for the system to ther- 
mally relax out of the computational state. However, this 
can only occur by disturbing the ancilla qubit out of the 
state |— ). By protecting the ancilla qubit, one can to a 
large degree protect the entire computation. Note that an 
energy penalty against the ancilla qubit leaving the state 
|— ) would be non-stoquastic. This is why the above con- 
struction fails to prove QMA-completeness and universal 
adiabatic quantum computation using the ground state 
of a stoquastic Hamiltonian, as we expect it must, based 
on the complexity-theoretic results of [Iol - fl2l [20| . 



III. QMA-COMPLETE PROBLEMS FOR 
MARKOV MATRICES 

The second main result of our paper provides an ex- 
ample of a QMA-complete classical problem: finding the 
lowest eigenvalue of a symmetric Markov matrix. A ma- 
trix with all nonnegative entries, such that the entries 
in any given column sum to one is called a stochastic or 
Markov matrix. These matrices are named after Markov 
chains, which are stochastic processes such that given the 
present state, the future state is independent of the past 
states. Suppose a system has d possible states. Then, 
its probability distribution at time t is described by the 
(i-dimensional vector xt whose entries are nonnegative 
and sum to one. If the system is evolving according to a 
Markov process then its dynamics are completely spec- 
ified by the equation Xt+i = Mx t where M is a d x d 
stochastic matrix. Note that, like quantum Hamiltoni- 
ans, Markov matrices often have tensor product struc- 
ture. For example, suppose we have two independent si- 
multaneous Markov chains governed by xt+i = Mxt and 
yt+i = Ny t . Then their joint probability distribution z 
is governed by z t +\ — (M (g> N)z t . 

Markov processes for which the Markov matrix is 
symmetric correspond to random walks on undirected 
weighted graphs. (Self-loops are allowed and correspond 
to diagonal matrix elements.) These matrices are doubly- 
stochastic: the sum of the entries in any row or column 
is one. By the Perron-Frobenius theorem, the highest 
eigenvalue of a symmetric stochastic matrix is one, and 
the corresponding eigenvector is the uniform distribution. 
The eigenvalue with next largest magnitude controls the 



rate of convergence of the process to its fixed point. A 
symmetric stochastic matrix is Hcrmitian and therefore 
one can also think of these matrices as Hamiltonians. 

To prove that finding the lowest eigenvalue of a 3-local 
symmetric stochastic matrix is QMA-complete, we again 
use a reduction from the QMA-complete Hxz Hamilto- 
nian of [8]. We must take the opposite sign convention 
from equation [3] 

H XZ = J2 a k S ^ (9) 

fe 

where the coefficients ctk are the same as before (all pos- 
itive) and Sk = —Tk- Now define: 

Hxz = ^J2 a ^ k ( 10 ) 

fc 

where 

N = "fe 
fe 

and Sk is the permutation matrix obtained by applying 
the replacement rules ([5]) to Sk ■ By construction, Hx z is 
a 3-local, symmetric, doubly stochastic matrix. We can 
rewrite Hxz as 

Hxz = ^ {Hxz ® |-X-| + Hxz <8 |+)(+|) , (11) 

where Hxz — Ylk ak I ^ k I ■ Thus, to determine an eigen- 
value of Hxz to within ±e we must find the correspond- 
ing eigenvalue of Hxz to within ±e/N. Because Hxz 
is a two-local Hamiltonian on n qubits with coupling 
strengths of order unity, N is at most 0(n 2 ). Thus 
the problem of determining the eigenvalue of Hxz cor- 
responding to the ground state of Hxz to polynomial 
precision is QMA-hard. 

To obtain a cleaner QMA-hard problem we would like 
to construct a stochastic matrix whose lowest eigenvalue 
is QMA-hard to find. To do this, let 

Hp = (1 - p)<r+ +1 +pH X z- 

Here a^ +1 = |+)(+| = |(1 + X n+1 ) acts on the ancilla 
qubit, thereby giving it an energy penalty of size (1 — 
p) against leaving the state |— ). For < p < 1, H p 
is a stochastic Hamiltonian. For p < 1/3 the energy 
penalty is large enough that the highest eigenvalue in 
the |— ) subspace lies below the lowest eigenvalue in the 
|+) subspace. In this case the lower half of the spectrum 
of Hp is the spectrum of Hxz scaled by p/N, and the 
upper half of the spectrum of H p is the spectrum of Hxz 
scaled by p/N and shifted up by 1 — p. 

Thus, we can obtain the ground energy of Hxz to 
polynomial precision by computing the lowest eigenvalue 
of Hp to a higher but still polynomial precision. This 
reduction proves that finding the lowest eigenvalue of H p 
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to polynomial precision is QMA-hard. Using the quan- 
tum algorithm for phase estimation, one easily shows that 
the problem of estimating the lowest eigenvalue of H p is 
contained in QMA (see [18|]). Thus this problem is QMA- 
complete. 



IV. FRUSTRATION FREE ADIABATIC 
COMPUTATION 

It was stated in [12j that universal adiabatic quantum 
computation can be performed in the ground state of a 5- 
local frustration- free Hamiltonian. Let U = Ul . . . U2U1 
be a quantum circuit acting on n qubits with L — poly(n) 
gates. Let 



\^)=U j ...U 1 \Q) 



(12) 



be a state of n qubits corresponding to the j th state of 
the time evolution of a quantum circuit specified by gates 



Uj and 



U t+1 o L - t ) 



(13) 



be a state of L + 1 clock qubits. Bravyi and Terhal con- 
struct a parametrized 5-local Hamiltonian H(s) such that 
the ground state \i(j(s)} satisfies 



3=0 
L 



3=0 



We can think of first register in \ip(s)) as consisting of 
"work" qubits on which the computation happens and 
the second register in \ip(s)} as being a clock containing 
a time written in unary. 

For s £ [0, 1], the minimal eigenvalue gap between the 
ground state and first excited state of H(s) is 0(1/ L 2 ). 
By the adiabatic theorem [29j], l/poly(L) eigenvalue gap 
ensures that given \ipo), one obtains |V>i) by applying 
H(s) and varying s from zero to one over poly(L) time. 
By measuring the clock register of \ip(l)), one obtains 
the result |1 L+1 ) with probability l/(L + 1). If this re- 
sult is obtained, one finds the output of the circuit U 
by measuring the first register of qubits in the computa- 
tional basis. By repeating this process with O(L) copies 
of I -0 ( 1 ) ) one succeeds with high probability. Alterna- 
tively, one can pad the underlying circuit with L identity 
gates, in which case each trial succeeds with probability 
1/2. 

The construction from [12| invokes the fact that the 
spectrum of H (1) is independent of the form of the gates 
Uj . By choosing a gate set which is composed of elements 
of simply connected unitary groups such as SU(2) and 
SU(A) one may construct a continuous path connecting 
each gate to the identity, and use a single parameter s 



to transform all gates from the identity to the final cir- 
cuit at once. The Hamiltonian at s = corresponds to 
the identity circuit, and its ground state is the uniform 
superposition of the clock states tensored with the ini- 
tial data on the work qubits. In this ground state, the 
qubits of the clock register are entangled. It is standard 
to design adiabatic computations such that the initial 
Hamiltonian has a product state as its ground state, be- 
cause such states should be easily produced by cooling or 
single-qubit measurements. In this section we construct 
a modified version of the construction from [l2j that sat- 
isfies this condition and is still frustration free. 

Let c(j) indicate the j th clock qubit and let w(j) indi- 
cate the j th work qubit. Let 



H 



imt 
3 

clock 



- |i)<iU w) ® |io)(io| c(1) , c(2) 

= |01)<01| ca _x), cW 



For j e {1, L-l} define 

00 



T^prop 

3 



and let 



Hr v (s) 



s|100)(100| c(j ) )C(j+ i) )C(j+2 ) + 
(1 - s)]110)<110| c(j ) )C(j+1 ) )CCj+2 ) - 
y/s(l - s) (Uj ® |110)(100| c0 - )ic0 - +1)iC(i+2) - 

U] ® |100)(110| c y )lC y + i) lC y + 2)' 



s|10)(10| c(L ) !c(L+1) + 
(1- S )|ll)(ll| c(i) , c(i+1) - 

y/a(l - s) (U L ® |ll)(10| c(£))C(i+1)) - 

ul® |10)(11| C(L) , C(L+1) 



It can be directly verified that each i?J lock , Hj nlt , and 
Hj mp (s) is a projector. Here, for convenience, we de- 
fine s so that it varies from zero to one half rather than 
from zero to one as is done in Our frustration-free 
Hamiltonian is the following sum of projectors: 



y^clock 
^init 

H piop (s) 
H FF (s) 



\0)(0\ c{0) +J2 H j 
3=1 



lock 



rimt 

3 



Y, H 3 

3 = 1 

X>f' OP (s) 

3=1 



If Ui . . . Ul are chosen from a universal set of two-qubit 
gates then H FF (s) is an efficient 5-local frustration- free 
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adiabatic quantum computer. To see how this Hamil- 
tonian achieves universal adiabatic computation, we ex- 
amine the various terms one by one. The ground state 
of H FF (s) is the simultaneous zero eigenspace of JJ clock , 
# init , and HP r °P. H clock commutes with ffP ro P(s) +H init 
and provides an energy penalty of at least unit size if the 
clock register is not in one of the unary states \c±) = 
|l t+1 i_t ). Thus the low lying spectrum of H FF (s) is 
strictly contained in the ground space of JJ clock . 

For any bit string x £ {0, 1}™ and integer j £ 
{1,2,...,L}, let 



where |c, 
IxS) 



\xi) = (U j U j - 1 ...U 1 \x))®\c j ), 

uj j is as defined in equation [T31 (We also define 
\x) ® |co) ■) There are 2 n (L + 1) such states and 
they form an orthonormal basis for the ground space of 
H ciock . In this basis, £TP r °P(s) + H init takes the block- 
diagonal form 

H prop (s) + H init = M x 

xG{0,l}~ 



where 



s+\x\ -b 
-b 1 -b 

-b 1 -b 



-b 1 -b 
-b 1 - s 



is an L + 1 by L + 1 matrix and 6 = \J s(l — s). Here 
\x\ denotes the Hamming weight of the bit string x. The 
appearance of |x| is the sole manifestation of H lnlt . The 
rest of the matrix elements all come from the "hopping" 
action of tfP r °P(s). 

M00...0 has the unique ground state 



(14) 



where and \cj) are as defined in equations 1 1 2 1 and 



and N is a normalization factor. This 
constitutes the ground state of H FF (s). The first excited 

Be- 



5) cosf^ 



state of Moo. . .0 has energy 1 — 2 y/ s(l - a , wo , 

cause of the direct sum structure of H FF (s), we can ap- 
ply the adiabatic theorem directly to Moo...o- The run- 
time of the adiabatic algorithm is thus determined by 
the gap between the ground and first excited states of 
Moo. ..o- This takes its minumum at s = 1/2, where it 

is equal to 1 — cos ( jj^^ j = 0(1/ L 2 ). For questions 

of fault tolerance it is also useful to know the eigenvalue 
gap between the ground and first excited states of the 
full Hamiltonian H FF (s). The first excited energy of 
H FF (s) is equal to the ground energy of M10...0, which is 



1-2^/^T 
value gap of H 

1 _ C0S 1 2(L+1) 



s) cos ( 2 (L+i) ) ■ Thus the minumum eigen- 
>Ff s) occurs at s 
■0(1/L 2 ). 



1/2 and is equal to 



By equation [Ml the ground state of H FF (0) 



is 



|000 . . .) g) 1 1000 . . .), and the ground state of H bb (1/2) 
is the same state I i ) I c j ) produced by the 

scheme of 1131. 



STOCHASTIC FRUSTRATION FREE 
COMPUTATION 



In [12J , Bravyi and Terhal showed that adiabatic quan- 
tum computation in the ground state of a stoquastic frus- 
tration free Hamiltonian can be efficiently simulated by 
a classical computer. In this section we show that in con- 
trast, one can perform universal adiabatic quantum com- 
putation in the ground state of a stochastic frustration 
free (StochFF) Hamiltonian H stochFF (s). (Alternatively, 
we can view this as computation in the highest energy 
state of the stoquastic Hamiltonian —H StochFF (s).) 

It has been shown that the two-qubit CNOT gate, to- 
gether with any one-qubit rotation whose square is not 
basis preserving, are sufficient to perform universal quan- 
tum computation [25[ . All matrix elements in these gates 
are real numbers. If we choose Ui, . . . , Ul from this gate 
set then H FF (s) is a 5-local real frustration free Hamil- 
tonian. Examining the construction of section Mil one 
sees that it can be applied to any Hamiltonian with real 
matrix elements, and it increases the locality by one. 
This construction also preserves frustration-freeness, as 
we will show in the next paragraph. We can thus use 
this construction on H FF (s) to obtain a 6- local stochas- 
tic frustration free Hamiltonian whose ground state is 
universal for adiabatic quantum computation 

To show that the mapping of section IIIII preserves 
frustration-freeness, consider applying this mapping to a 
frustration free local Hamiltonian H = SJLi H31 where 
Hj = J2k a k^l (where each S 3 k is, up to an overall sign, 
a tensor product of Pauli operators and each oP k is posi- 
tive). We obtain the Hamiltonian 



H p - pH+(l-p) 



t+X. 



n+l 



N 



pHj + il-p) 



1 + x n+1 



(15) 



where Nj = £\ a t an d N 



-0 ~ A^k^k a ^ ^ ~ i^j^j- when P <\, H p 
is stochastic and has a zero energy ground state with an 
eigenvalue gap which is -j^ times the gap of H . Further- 
more we see from (fTS"]) (and the fact that each Hj is posi- 
tive semidefinite) that H p is a sum of positive semidefinite 
operators. Hence the Hamiltonian H p is frustration free. 
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VI. GENERALIZATIONS 



where 



The constructions of sections Hill and [TTI replace Hamil- 
tonians with real matrix elements of both signs by com- 
putationally equivalent Hamiltonians with real positive 
matrix elements. In this section we show that this tech- 
nique can be generalized to directly replace Hamiltoni- 
ans with complex matrix elements by computationally 
equivalent Hamiltonians with only real positive matrix 
elements. However, in the process we necessarily intro- 
duce a two-fold degeneracy of the ground state. 

Let if be an arbitrary fc-local Hamiltonian. We may 
expand if as 



(16) 



where each Oj is a tensor product of k or fewer Pauli 
matrices and each aj is positive. Each entry in each Oj 
is ±1 or ±i. We can replace the group {1, i, — 1, — i} with 
its left-regular representation 



where 



i t-> F 
-1 h> F 2 
-i i-> F 3 

mF 4 



/0 1 0\ 

10 

1 

\l 0/ 



(17) 



(18) 



The eigenvectors of F are \vq), \vi), |i>2), \va) where 

l«i> = 5E' 



1=0 



The corresponding eigenvalues are 

F\v4)=i?\vi). 



(19) 



Let Sj and Aj be the real and imaginary parts of otj Oj . 
That is, Sj and Aj are the unique real symmetric and 
anti-symmetric matrices such that 

(XjOj = S + iA 



Further let S*+ = (\S 3 \ + S 3 )/2) and Sj 



{\Si\-Si)/2 

and similarly for A?, where | • | denotes the entrywise 
absolute value. Applying the replacement (IT71) to if and 
dividing by N = J2j a j yields the stochastic Hamiltonian 
H with the decomposition 



if = 



jf (ff (0) ® |t> )(v | + ff (1) ®h)(wi|+ 

HW®\v 2 )(v 2 \+HW® \v 3 )(v s \) (20) 



11 K ' 


3 


+ bj 


+ 4? 4 




H (l) 




- s 7 


+ iA+ 


-iAj 


H (2) 




+ Sr 




- A J 






~ s 7 







if^ = if, thus the spectrum of if in the subspace 
matches that of if up to a normalization factor of TV and 
a pair of extra ancilla qubits. If we write each projector 
lujXujl in terms of the Pauli basis we obtain 



M{vo\ 
\v 2 )(v 2 \ 

l«3><«3| 



n x u x 
u x ul 

u x n Y 



where is the projector onto the eigenvalue ±1 eigen- 
state of the Pauli matrix a. Thus an X penalty on the 
first ancilla qubit will separate the \vi), {1)3) subspace 
from the |uo),|i>2) subspace. So, taking, < p < |, 
the stochastic Hamiltonian 



has ground space spanned by \iIj^)\vi) and \ip^)\v3), 
where IV'' 1 ' 1 ) is the ground state of i?W and \^ 3 ^) is 
the ground state of if (3) . if (1) = if, thus |V> (1) ) is the 
ground state of if. — if*, thus IV^ 3 -*) is the complex 
conjugate of the ground state of if. 

A simple argument shows that the doubling in the 
spectrum of H' p is a necessary property for any construc- 
tion which maps an arbitrary Hamiltonian onto a real 
Hamiltonian H R , where H R is equal to if within a fixed 
ID subspace of the ancillas. Suppose that we have such 
a map which sends an arbitrary Hamiltonian if which 
acts on a Hilbert space "Hi to a real Hamiltonian H R on 
a larger Hilbert space Hi (8 if 2 with the property that 



H R = H® + if othcr ® (1 - \<j>){4>\) 



(21) 



where the state \<j>) £ H2 does not depend on the partic- 
ular Hamiltonian if but the operator 7J othcr m ay depend 
on if. Then for any eigenvector \tp) of if with energy E 
we have: 

H R m<j>) =E\j>)\4>) (22) 
Since H R is real, complex conjugating this equation gives: 

H R \rw)=E\rw) (23) 
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To show that doubling exists in the spectrum it is suf- 
ficient to show that (<f>\(j>*) = 0. To prove this, first use 
equation (|23|) to obtain 



(i ® H R \rw) = E\r)\4>)m*) 

Then use equation (|2ip to obtain 



(1 ® HjjIV*)^*) = (#1^*)) 1^X010*)- (25) 



fc-SAT looks somewhat different from the definition of 
quantum fc-S AT which was given in section [IJ which was 
stated entirely in terms of projectors. Given an instance 
of stoquastic fc-SAT, we can define operators ILj which 

(24) 

project onto the zero eigenspaces of the Hj. When 
the Hamiltonians Hj are stoquastic, these projectors 
are guaranteed to have nonnegative matrix elements in 
the computational basis 12j. So given an instance of 



Equating these expressions gives 

H\r)(<t>\<t>*) = Emm*) 



(26) 



This must hold for all Hamiltonians H and eigenstates 
and therefore it must be the case that (4>\4>*) — 0. So 
we have shown that the doubling in the spectrum of H' p 
is a necessary feature of the type of maps we consider. 
For constructing universal adiabatic quantum comput- 
ers the degeneracy induced by this construction may be 
problematic. However, for proving complexity-theoretic 
completeness results it is often irrelevant, as we see in 
the next section. 



VII. STOCHASTIC fc-SAT 

The methods of the previous section can be used to 
show, roughly speaking, that deciding whether or not 
a Hamiltonian which is a sum of positive semidefinite 
stochastic operators is frustration free is as difficult as 
the general problem of deciding whether a Hamiltonian is 
frustration free. In this section we formalize this by defin- 
ing a problem called stochastic fc-SAT, which we show to 
be QMAj-complete for k = 6. 

We first recall the definition of stoquastic fc-SAT 
which is given in [12j. 

Problem: Stoquastic fc-SAT 

Input: Input: A set of fc-local Hermitian operators 



{Hj} for j € {l,...,m} where m 
parameter e > l/poly(n) 

1. Each Hj is positive semidefinite 



poly(n) and a 



2. Each Hj has norm which is bounded by a polyno- 
mial in n. 

3. Every Hj is stoquastic. 

Output: If H = J2j Hj has a zero energy ground 
state, then this is a YES instance. Otherwise if every 
eigenstate of H has energy > e then it is a NO instance. 
Promise: Either the ground state of H has energy 0, or 
else it has energy > e. 

The stoquastic fc-SAT problem is therefore the problem 
of deciding if a given stoquastic Hamiltonian that is 
a sum of positive definite operators is frustration free, 
given that either this is the case or else its ground energy 
exceeds e [12J. Note that this definition of stoquastic 



stoquastic fc-SAT with Hermitian positive semidefinite 
operators Hj , it is possible to construct another instance 
of stoquastic fc-SAT with operators Hj = {1 — H, } that 
are all projectors. 

We now define a problem called stochastic fc-SAT, 
which is identical to stoquastic fc-SAT except that 
condition 3 is replaced by 

3'. Every Hj is a stochastic matrix. 

We note that there does not appear to be an equivalence 
between this definition of stochastic fc-SAT and the cor- 
responding definition where all the Hj are (in addition) 
required to be projectors. 

Given these two definitions and the foregoing map from 
an arbitrary Hamiltonian to a stochastic Hamiltonian, we 
now show how to reduce any instance of quantum 4-SAT 
to an instance of stochastic 6-SAT. Starting with an in- 
stance of quantum 4-SAT specified by a set of projectors 
{Tlj} (for j £ 1, ...,m) we use the map of the previous 
section (with p = | for concreteness) on each projector 
to obtain a set of 6-local positive semidefinite stochastic 
Hamiltonians {Hj} where 



H, 



t + X n 



in, 

3 3 



(27) 



(Note that n,- refers to the operator obtained by apply- 
ing the mapping from equation (|20|) .) If the 4-SAT in- 
stance is satisfiable, then the stochastic 6-SAT instance 
will also be satisfiable. Define N max to be the maximum 
value of N obtained for one of the terms H, when using 
the mapping of equation (|20|) . If the 4-SAT instance is 
not satisfiable then for any state \(j>) there is some pro- 
jector Ilk such that (0|IIfc|0) > — . If we take the pa- 
rameter e of the stochastic 6-SAT instance to be related 
to the parameter e of the quantum 4-SAT instance by 
then the stochastic 6-SAT instance will also 



be unsatisfiable. Therefore stochastic 6-SAT is QMA 1 
hard. Stochastic 6-SAT is contained in QMAj since ev- 
ery instance of stochastic 6-SAT can be mapped to an in- 
stance of quantum 6-SAT by taking projectors which 
project onto everything but the zero eigenspaces of the 
Hj. 

So QMAj^ completeness of stochastic 6-SAT follows 
from the results of Bravyi Q on quantum fc-SAT. This 
is in contrast to stoquastic fc-SAT, which is contained in 
MA for every constant fc [l2j . 
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VIII. QMA-COMPLETENESS FOR EXCITED 
STATES 

The local Hamiltonian problem refers specifically to 
ground state energies. Similarly, we have formulated 
a computational problem based on the highest energy 
of a given Hamiltonian. It is natural to ask about 
the complexity of estimating the c th excited state. 
We can formulate this as follows. Let H be a fc-local 
Hamiltonian on the Hilbert space % of n qubits. Let 
Ai < A2 < . . . < A2" denote the eigenvalues of H, with 
corresponding eigenvectors \tpi), \tp2), ■ ■ ■ , 1^2™ )■ The 
(k, c, e)-energy problem is as follows. 

Problem: (k, c, e)-energy 

Input: We are given a classical description of H, an 
integer c > 1, and a pair of parameters a, b such that 
b — a = e > l/poly(n). 

Output: If A c < a answer YES. If A c > b output NO. 
Promise: H is such that the answer is YES or NO. 

In this section we will show that the (fc, c, e)-energy 
problem is QMA-complete for any c = O(l). Show- 
ing QM A- hardness is the easier of the two proofs. 
This can be achieved as follows. Let and 
be a pair of /c-local Hamiltonians on n qubits, with 
spectra \[ a \ . , A 2 a „\ |^ a) >, ■ ■ • , and \[ b \ . . . , A&>, 

\ip[ b ^}, ■ ■ • , respectively. Then 

H (ab) = H (a) ^ | ^0| +fl -(6) g, 

is a (fe + l)-local Hamiltonian on 71 + 1 
qubits. Its complete set of eigenvalues is 

Aj°' , . . . , A 2 ? ; A^ , . . . , A 2 n , with corresponding eigen- 

vectors |^ a) )|0), . .., |V^)|0); l4 b) )|l), ••• , |</$)|1). To 
prove QMA-hardness of a low-lying excited state let Hq 
to be a Hamiltonian such that determining whether the 
ground energy is close to zero is QMA-hard. Given an 
integer c, let d = [log 2 c], Pk = \{Zu + 1), and 




H c has exactly c states with negative energy, and its low- 
est nonnegative eigenvalue is | . Thus determining the c th 
excited energy of H c ® |0)(0| + H ® |1)(1| is QMA-hard. 
In particular, it is interesting to note that by choosing 
c = 2 we construct a Hamiltonian whose eigenvalue gap 
between the ground state and first excited state is QMA- 
hard to compute. 

Next we show containment in QMA. The naive proto- 
col would be for Merlin to provide Arthur with the state 
IV'i)!^) ■ • ■ IV'c) and for Arthur to use phase estimation 
to check that the c registers each contain a state of energy 
at most a. The problem is that for "no" instances there 
are many ways for Merlin to cheat. For example if Ai < a 
but A c > b, the answer is "no" but Merlin can provide 



the state \ipi)® c as a supposed witness. To prevent this, 
Arthur needs to somehow check that he has been given a 
set of c orthogonal states that each have energy at most 
a. Thus we propose the following protocol. 

Arthur demands that Merlin give him the state 

\W) = sign(7r)|W(i))IVV(2)) ■ • ■ l^r(c)}- (28) 

Arthur performs the projective measurement to see that 
the state given to him by Merlin lies in the antisymmetric 
subspace of r H® c . If this fails he rejects. He then throws 
away all but the first register and performs phase esti- 
mation of H to precision better than e. If the state has 
energy above b he rejects. Otherwise he accepts. 

It is clear that for YES instances, Arthur will accept 
the state \W) with high probability. (The only source of 
error is imprecision in phase estimation.) We will next 
prove that for NO instances the acceptance probability 
is at most 1 — -. Using standard methods pH, I2H [22l| we 
can amplify this protocol to obtain polynomially small 
acceptance probability for NO instances. 

Lemma 1 For any state |</>) in the antisymmet- 
ric subspace of Tl® c and any state \a±) G %, 
(<fi\ (|ai)(ai| <S> 1) \4>) < - where 1 is the identity oper- 
ator onH®^-^. 

Proof: Extend \a{) to an orthonormal basis 
\cti), \ct2), . . . , \ct2 n ) for H. Let F be the set of functions 
/ : {1, 2, . . . , c} -> {1, 2, . . . , 2"} such that /(l) < /(2) < 

. . . < /(c). Thus \F\ = ( 2 c "). For any f € F we have the 
corresponding Slater determinant state. 

I" /) = 7|E Si g n ( 7r )l a /( 7 r(l)))l«/( 7 r(2))) ■ • ■ |a/(*(c))) 

It a standard result that these ( 2 ) states form a com- 
plete orthonormal basis for the antisymmetric subspace 
of H® c . For any /, g g F we have 

(D f \(\a 1 ){a 1 \®t)\D g )= 6f ' 36f c V' 1 (29) 

where each S denotes a generalized Kronecker-^. Because 
|0) is antisymmetric, it can be decomposed in the Slater 
determinant basis: 

\<t>) = J2<i>f\Df) 

and pf = (f>%(f>f is a corresponding probability distribu- 
tion on F. Thus 

(0| (KXaxI ® 1)|0) - 
J2 0}(D f \(\ ai }( ai \®t)\D g )<b g . 

f,9£F 
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By equation [29] this is 

= -E^'M - c' 

□ 

The quantity 

P M = (<l>\(\i>j)(^\®V\4>) 

is the probability of obtaining if we measure the first 
register of a state \(j>) in the eigenbasis of H. By lemma 

CD 

3=1 

Thus, with probability at least -, such a measurement 
would yield \tpj) with j > c — 1. Thus if A c > b then with 
probability at least - a measurement of the observable 
H would yield energy at least b. The phase estimation 
algorithm can in poly(l/e) time perform such an energy 
measurement with exponentially small chance of making 
an error as large as e. Thus the protocol is sound, which 
completes the proof that the (c, k, e)-energy problem is 
QMA-complete for constant c and k and polynomially 
small e. 



IX. DISCUSSION AND CONCLUSIONS 

The results presented in this paper have several appli- 
cations. Although calculating the ground state energy 
of stoquastic Hamiltonians appears easier than calculat- 
ing the ground energy of generic Hamiltonians, our re- 
sults suggest that calculating other eigenstates of sto- 
quastic Hamiltonians remains hard. Because the wave- 
functions of these states have amplitudes which are both 
positive and negative, the hardness of determining their 
energy supports the intuition that it is the positivity 
of the amplitudes which makes the ground state prob- 
lem for stoquastic Hamiltonians easier. An extreme dis- 
tinction between stochastic and stoquastic Hamiltoni- 
ans arises when the Hamiltonians are also frustration 
free. Although adiabatic evolution with stoquastic frus- 
tration free Hamiltonians is simulable in BPP [l2j], we 
have shown that adiabatic evolution in the ground state 
of a stochastic frustration free Hamiltonian is universal. 



Secondly, these results may be relevant for the physical 
implementation of quantum computers. The first proof 
of universality of adiabatic quantum computation used 5- 
local interactions Q. Since then, the Hamiltonians have 
been brought into incrementally more physically feasi- 
ble form by various techniques while retaining universal- 
ity [H, [l7|, HI. The universal Hamiltonian H xz of [| is 
one outcome of this chain of reductions. Here we add one 
more step to this chain, obtaining universal stochastic 
and stoquastic Hamiltonians which resemble those aris- 
ing in some systems of superconducting qubits [Tl| . The 
constructions given here are at least three local, and so 
would require the use of perturbative gadgets to imple- 
ment in terms of physical two-local interactions. 

Finally, our results are of interest from a purely 
complexity-theoretic point of view. Stochastic matri- 
ces arise outside the context of quantum mechanics, in 
Markov chains. Our reduction shows that finding the 
lowest eigenvalue of a certain class of exponentially large 
but efficiently describable doubly-stochastic matrices is 
QMA-complete. (These stochastic matrices correspond 
to Markov Chains in which the "update rule" is a proba- 
bilistic selection over some set of updates which are local 
in the tensor product sense.) In general, the problem 
of finding eigenvalues of stochastic matrices is of inter- 
est because the eigenvalue of second largest magnitude 
determines the mixing time of the corresponding Markov 
chain. There exist Markov chains in which the eigenvalue 
of second largest magnitude is negative, and is the lowest 
lying eigenvalue. We hope that the demonstration of a 
QMA-complete problem arising in a classical setting will 
help shed further light on the class QMA itself. 
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